Tempering simulations in the four dimensional ±J Ising spin glass in a magnetic field 
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We study the four dimensional (4D) ± J Ising spin glass in a magnetic field by using the simulated 
tempering method recently introduced by Marinari and Parisi. We compute numerically the first 
four moments of the order parameter probability distribution P{q) . We find a finite cusp in the spin- 
glass susceptibility and strong tendency to paramagnetic ordering at low temperatures. Assuming 
a well defined transition we are able to bound its critical temperature. 



Spin glasses are systems which deserve considerable 
theoretical interest due to the interplay between random- 
ness and frustration ||l| . The role of the frustration in the 
statics and dynamics is essential to understand the na- 
ture of the low temperature phase. Despite great progress 
during the last decade in the understanding of the mean- 
field theory of spin glasses, a large number of topics are 
still poorly understood. In particular, it is completely 
unclear which features of the mean-field theory survive 
in finite dimensions. This problem has recently received 
considerable attention ^-^ and has become the corner- 
stone to validate the correct description of the spin glass 
state. 

The reason why this topic still remains open relics on 
the absence of a convincing final theory for the spin glass 
state. Efforts to construct a field theory of the glass state, 
based on the Parisi solution to the mean-field theory, 
have been done mainly by De Dominicis, Kondor and 
Temesvari B. Despite a large number of new results, a 
clear answer to the finite dimensional issue is still missing. 

After the Parisi solution to the mean-field theory, a 
new phenomenological approach to the spin-glass state 
based on the Migdal-Kadanoff renormalization group ap- 
proach was proposed by McMillan |0], Bray and Moore 
[g[ and later on analyzed in detail by Koper and Hil- 
horst 1^ and Fisher and Huse [Q. In this approach, the 
zcro-tcmpcrature fixed point completely determines the 
properties of the low temperature phase. This approach 
gave a description of the spin glass state, now called the 
droplet model, where the thermodynamics is determined 
by two Gibbs states (related by spin inversion symme- 
try) plus a spectrum of excitations and corresponds to 
the inversion of compact domains of finite size (droplets) . 
This picture of the spin-glass state lacks the most pecu- 



liar feature of the mean-field theory, i.e. the coexistence 
of a large number of phases or states in the spin-glass 
phase. 

Recently, exact results have been obtained by New- 
man and Stein |y] and also by Guerra [g| on which fea- 
tures of the spin glass state, present in the Shcrrington- 
Kirkpatrick (SK) model ||6|], survive in finite dimensions. 
Numerical simulations are one of the few confident tools 
that we can use to investigate this problem and clar- 
ify the controversy |ll[ | . With the aid of numerical sim- 
ulations, two main questions in spin glasses have been 
addressed. The first one concerns the low temperature 
behavior of the model in zero magnetic field. The second 
one concerns the existence of the spin-glass transition in 
a magnetic field similar to the one found by de Almeida 
and Thouless in the mean-field case [0| (the so called 
AT line). A clearcut answer to these questions would be 
very useful as a guide for constructing a theory of the spin 
glass state in finite dimensions. While the first problem 
has received considerable attention, very few results have 
been obtained for the second one. 

The purpose of this work is the study of the existence 
of spin-glass state in a magnetic field. This work is the 
natural continuation of previous numerical simulations 
done in the SK model in a magnetic field, where the ex- 
istence of a replica symmetry broken phase, as predicted 
by Parisi ||lj| , was verified through the study of the over- 
lap probability distribution P{q) ||l^. In that work we 
also studied the four dimensional (4D) ± J Ising spin glass 
in a magnetic field in the low T phase but did not find 
evidence for a P{q) of the mean-field type, even though 
we were not sure that equilibrium was achieved for the 



largest sizes [|. In order to investigate the existence of 
a transition line in a magnetic field we have performed 
extensive tempering Monte Carlo simulations in the ± J 
Ising spin glass in four dimensions. 

The model and the numerical algorithm. We have con- 
sidered the model described by the Hamiltonian, 



-ff = - 2J Jij ^i<^j ^hyaj 



(1) 



(*j) 



where the spin variables ai take the values ±1, the Jij 
are random discrete ±1 quenched variables and h denotes 
the magnetic field. The spins are located in the sites of a 
4D cubic lattice of size L and N = L"^ sites with periodic 
boundary conditions. 

In order to reach the maximum cfhciency in the Monte 
Carlo simulations we have used the tempering method 
introduced by Marinari and Parisi [E0[. This is a Monte 
Carlo method in which the temperature is a dynami- 
cal variable and the system can change the temperature 
while always being in thermal equilibrium. The system 
performs a random walk in temperature in such a way 
that low temperature equiprobable configurations sepa- 
rated by high energy barriers can be efficiently sampled. 
For a description and details about this algorithm, the 
reader is referred to |2l| ]. 

In what follows we briefly describe the numerical pro- 
cedure we have followed. Samples are cooled down, at 
constant magnetic field /i, starting from the high temper- 
ature phase (above the critical temperature at zero field 
Tc ~ 2.0 ^) down to T = 1.0 and the internal energy 
e/3 = {TL) is estimated as a function of /3 for a selected 
set of Nfj different values of [3 {N/s = 50 for the largest 
sizes) . The separation A/3 between the different values of 
/3 is taken such that the tails of the probability distribu- 
tions of the energy for different neighboring temperatures 
do superimpose. For sake of simplicity the different val- 
ues of (3 were taken equidistant with A/3 = 0.03 for the 
largest sizes. It is important to note that all multicanon- 
ical methods are expected to work if the thermodynamic 
chaos (to be discussed below) is small. The weakness of 
chaotic effects in temperature for finite sizes was numer- 
ically checked for the SK model [E2| as well as for 4D ± J 
Ising spin glasses Q. 

Starting from a random initial condition and an initial 
temperature /3r, all the spins are sequentially updated 
at each Monte Carlo step (MCS) and single spin flips 
are accepted with a probability given by the heat bath 
algorithm. After each MCS a change in temperature is 



*We chose to study 4D instead of 3D because the evidence 
in favor of a phase transition at zero field is less obvious in 
this last case (hd-tol. Moreover the AD model is easier to 
thermalize than in 3D. 



proposed Pr — > Pr+i or Pr — > Pr-i, each with a prob- 
ability 1/2. The change in temperature A/3 is accepted 
with probability exp(-A/3(i?((T) — (e^-)-e/5+A/3)/2.)). The 
spins are again updated and the change of temperature 
is again proposed. In this way one is able to compute the 
equilibrium values of different observables for all values 
of p. In order to increase the statistics we have simu- 
lated 8 different replicas in parallel in a multispin coding 
program. 

Before presenting the numerical results, we will com- 
ment about chaotic effects in spin glasses and then ex- 
plain how we choose the value of the magnetic field for 
our simulations. 

Thermodynamic chaos in spin glasses. One of the main 
properties of spin glasses is the existence of chaotic ef- 
fects when some external parameter like the tempera- 
ture or the magnetic field is changed |g 24 1 . This feature 
is present in the mean-field approach as well as in the 
droplet model at zero magnetic field. In the framework of 
mean-field theory of spin glasses, the physical meaning of 
thermodynamic chaos is rather intuitive. It is related to 
the fact that small energy perturbations can redistribute 
the (small) free energy differences of the many equilib- 
rium states modifying completely their equilibrium sta- 
tistical weights. In the framework of droplet models, en- 
ergy perturbations can strongly modify spin correlations 
due to the fractal nature of the droplet domain walls. 
We note that thermodynamic chaos is a real effect of the 
spin glass phase. According to the droplet model, the 
effect of a uniform magnetic field is to suppress the spin 
glass phase, hence chaotic effects in temperature disap- 
pear if the system becomes magnetized. The simplest 
way to measure chaoticity in spin glasses is by defining 
the chaos correlation length associated to th e q — a cor- 
relation function at large spatial distances x ^^^^ , 



Cchaos{x) = (qi qt+x) ^ X ^ exp(- — ) (2) 

where qi = aiTi and ai,Ti denote the spins of the unper- 
turbed {Hoia)) and perturbed system {HpiTJ) respec- 
tively and the expectation value < .. > is taken over the 
equilibrium Boltzmann distribution associated to the full 
Hamiltonian 7i(cr, r) = 'Ha{a) + Hpir). /j, is a positive 
exponent. The chaos correlation length ^c gives an esti- 
mate of the typical size of spatial regions which are simi- 
lar in the unperturbed and perturbed system. When the 
intensity of the perturbation goes to zero, the chaos cor- 
relation length ^c diverges and the divergence is related 
to the particular type of perturbation. 

For magnetic field perturbations, we know that chaotic 
effects are quite strong R. This effect sets a limit for the 



'In contrast with chaotic effects in the presence of tempera- 
ture perturbations which are small [p4lj2a,p4 



value of the magnetic field that we can use in simula- 
tions. This is the most relevant parameter in the sim- 
ulations because it determines how close we are to the 
h = spin-glass phase. The value of h cannot be too 
large otherwise, if a spin glass transition exists, it will be 
pushed down to very low temperatures. Also it cannot 
be too small otherwise the results are strongly affected 
by the h = spin-glass phase for the finite sizes we have 
studied. The crossover between the h = behavior and 
the finite h behavior depends on the chaos correlation 
length ^c{h) defined in eq.(||). The value of the magnetic 
field h has to be chosen in such a way that ^c{h) < L for 
the explored lattice sizes but not too large as explained 
previously. We have found that a good compromise is 
the value h = OA which yields a macroscopic magneti- 
zation at low temperatures of order 0.15. Then, we can 
estimate from independent Monte Carlo simulations (see 
p2| ) that £,c — 5 for the lowest temperature T = 1. We 
expect that simulations for sizes above L = 5 can yield 
convincing results on the existence or absence of phase 
transition at this value of the field. 

Numerical results. Simulations were performed for the 
following sizes L = 3, 5, 7, 9 with 1000, 325, 120, 130 sam- 
ples and Nf^ = 20,40,50,50 respectively ranging from 
Trmn = 1-0 up to Tmax = 2.5 (or Tmax = 3.0 for the 
smallest sizes L = 3,5). For the largest size L = 9 
the number of temperatures was not large enough to 
achieve equilibrium at low temperatures, hence we will 
show the data only for temperatures above T ~ 1.6 for 
that size. In figure 1 we present results for the magneti- 
zation A/ = jf ^j (Ji at different temperatures and sizes. 
Instead of plotting directly the magnetization we plot the 
ratio r{T,L) = ^j^. This quantity (due to a local gauge 
symmetry of the disorder ||lH]) should be equal to 1 above 
Tc{h = 0) ~ 2.0 in the limit of very small h. For finite h, 
because of the divergence of the spin-glass susceptibility 
at zero field, r is smaller than 1 (at T = 2.5 it is of order 
.7) but converges to 1 quite fast at high temperatures 
where the spin-glass susceptibility vanishes like P^. The 
important result which emerges in figure 1 is that below 
Tc{h = 0), r is linear with T. Consequently the magne- 
tization is nearly constant in the low temperature phase. 
This feature is also present in the mean-field theory and 
has been observed in the 3D case pffl as well as in field 
cooled experiments in spin glasses M. 
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More information about a possible phase transition can 
be obtained by directly measuring the spin-glass order 
parameter Q between two different replicas {u, r} with 



the same set of Jij, Q 
probability distribution. 



J2i '^iTi and its associated 



P.j{q)^{5{q-Q)) 



(3) 



where ((•)) denotes the thermal Gibbs average. In par- 
ticular, for each sample we calculated the first four mo- 
ments of the distribution (^). We have computed the 
mean value, the variance X, the skewness Y and the 
kurtosis Z of the distribution P{q) = Pj{q) where (•) 
means average over the disorder. The skewness and the 
kurtosis are a measure of the asymmetry and Gaussianity 
respectively of the overlap distribution. More precisely, 
if we define the following averages [/(<?)] — J dqf{q)P{q) 
we have. 



r = 



X = [{q-[q]r] 

[jq-jq])'] 
[{q-[qW 
_^_i.o [jq-jq])'] . 
r [{q-[qW?' 



(4) 
(5) 

(6) 



In figure 2, we plot the mean value [q] as a function of 
the temperature for different sizes. Data for L = 9 above 
T ~ 1.6 is nearly indistinguishable from data for L = 7. 
As shown in figure 2, we expect that [q] converges to a 
value close to 1 at zero temperature (but smaller than 1 if 



there is ground state degeneracy). The cumulants X, Y, Z 
give more information about a possible phase transition. 
They are expected to vanish in the L — > cxd hmit in the 
paramagnetic phase. Within an ordered phase of the 
mean-field type, where several pure states contribute to 
the Gibbs average, we expect X, Y, Z to be finite. In 
figure 3, 4, 5 we show NX,Y,Z (where N = L^) as a 
function of temperature for four different lattice sizes L = 
3,5,7,9. 
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FIG. 2. Mean value [q\ as a function of temperature. From 
bottom to top L = 3, 5, 7, 9. Data for L = 9 is hardly distin- 
guishable from L — 7. 

Figure 3 is quite interesting. We observe the presence 
of a cusp in the spin-glass susceptibility for sizes L = 5,7. 
This cusp moves to higher temperatures as the size in- 
creases (for L = 3 such a cusp is not observed in the 
range of temperatures explored). The observation of this 
effect already for L = 5,7 reveals that it is a real trend of 
the data and not a mere fluctuation. Unfortunately for 
L = 9 we have not been able to confirm or disprove this 
tendency (we have not succeeded in thermalize L = 9 at 
low temperatures). According to the droplet picture, the 
spin-glass susceptibility in the ± J model at zero temper- 
ature should be positive at finite field due to the ground 
state degeneracy (see the discussion in [^). Accord- 
ing to the mean-field picture, the susceptibility should 
diverge below the AT line. 
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FIG. 3. Spin glass susceptibility NX as a function of tem- 
perature. From bottom to top L = 3,5, 7, 9. 

Figures 4 and 5 show the parameters Y, Z for the dif- 
ferent sizes. What should be the manifestation of the 
existence of a second order transition line? For large 
enough sizes, one expects the adimensional quantities 
Y, Z to scale like Y = Y{L(T - T^Y) (the same for Z). 
Consequently they should display a crossing point for 
different sizes at T = Tc like happens at zero magnetic 
field [ |l3[ . The lines in figures 4 and 5 corresponding to 
L = 5, 7, 9 sizes have been indicated by full symbols in 
order to distinguish the general trend of the data from 
the results for L = 3. Figure 4 shows that the skewness 
is negative for finite sizes and above T ~ 1.5 it goes to 
zero when the size increases as expected in the param- 
agnetic phase. The same tendency is also observed in 
figure 5 for the kurtosis. It is interesting to note that the 
curves for L = 5, 7 for both the skewness and the kurtosis 
cross at the same temperature T 2± 1.5 which is an upper 
bound for of an hypothetical critical temperature. Un- 
fortunately, we have not covered a large enough range of 
sizes (L = 3 is too small) in order to have clear evidence 
of such a crossing point. Our results suggest the existence 
of paramagnetic ordering at least above T ~ 1.5 and we 
cannot exclude the existence of crossing point and hence 
a phase transition below that temperature. 
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FIG. 4. Skewness y as a function of temperature. Dotted 
line corresponds to L = 3, filled circles (L = 5), filled triangles 
(1/ — 7) and filled squares {L — 9). 
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FIG. 5. Kurtosis Z as a function of temperature. Dotted 
line corresponds to L = 3, filled circles (L = 5), filled triangles 
{L = 7) and filled squares {L — 9). 

From our data we reach the following three conclusions: 
1) From figures 4 and 5 we can conclude that a phase 



transition, if existing, appears below Tc{h = 0) ~ 2.0. 
Hence the transition temperature is pushed down by the 
magnetic field. 2) We clearly observe a change of behav- 
ior above L = 5 where the trend of the skewness and 
kurtosis as a function of the size changes. This crossover 
length is in agreement with the estimated chaos corre- 
lation length i^c — 5 for the value of the magnetic field 
h = 0.4 and should correspond to the size L such that 
the tail of the P{q) extending down to negative values 
is suppressed. 3) Most interestingly, figure 3 shows the 
existence of a cusp which does not grow very fast with 
the size of the system and which has to be appropriately 
interpreted, since it is in disagreement with the mean- 
field picture. If the spin-glass susceptibility is finite at 
zero temperature this cusp is then to be expected. This 
result suggests that if a transition exists, it should have 
non trivial finite-size effects. 

A word of caution is essential at this point. Spin 
glasses are extremely difficult to thermalize and this is 
probably the reason why small progress has been done in 
the understanding of their equilibrium properties. The 
cusp observed in figure 3 can indeed be suppressed in the 
presence of non equilibrium effects. The presence of this 
cusp was not observed in |13] but in that case the mag- 
netic field was larger {h = 0.6) and thermalization was 
achieved by simulated annealing which is a less effective 
procedure than tempering. 

It is important to note that the results we are pre- 
senting here are probably seen in a very narrow range 
of fields. For fields larger than h = 0.4, the cusps in X 
will move to lower temperatures and hence it is difficult 
to see them numerically since tempering does not work 
efficiently for very low temperatures. On the other hand, 
for smaller fields, the chaos correlation length would be 
larger and this would require to simulate much larger 
lattices in order to start to see the trend of the data. 

Our data can then be interpreted in the framework of 
two scenarios: 1) The transition is absent 2) The tran- 
sition exists and the cusp in the spin glass susceptibility 
is a finite size effect not incompatible with a divergence 
in the thermodynamic limit. In this case the transition 
should be above T ~ 1.25 (where the cusp of X in fig. 3 
for the largest size is located) and below T ~ 1.5 (where 
the crossing point for the skewness and the kurtosis is 
observed). It is difficult to go beyond such a conclusion 
and extremely careful work (full thermalization in each 
sample is compulsory) has to be done in order to dis- 
cern among these possibilities. A similar work on the 
Gaussian case (to avoid the ground state degeneracy) us- 
ing the replica exchange method recently proposed by 
Hukushima, Takayama and Nemoto |19] would be wel- 
come in order to check the main conclusions of this work. 
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